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SYSTEMS AND METHODS FOR CONCURRENT IMAGE CAPTURE 
AND DECODING OF GRAPHICAL CODES 

TECHNICAL FIELD 

[01] The present invention relates generally to graphical code readers. More specifically, the 
present invention relates to a graphical code reader that is configured to capture at least one new 
image while decoding a previously captured image. 

BACKGROUND 

[02] Computer technology has entered many areas to simplify manual tasks and to make 
information more readily available. Computer programs can be used for many purposes 
including assisting a person in performing his or her job. For example, word processors help 
computer users prepare documents, spreadsheet programs help users perform accounting 
functions and numerical analysis, diagnostic programs assist users in diagnosing problems, etc. 
There are many programs available to help users with almost any need they may have. 
[03] One way to input data into a computer program involves the use of machine-readable 
graphical codes ("graphical codes"). A graphical code is a graphical representation of 
information that consists of multiple graphical code elements having different light reflective or 
light emissive properties. Examples of different types of graphical codes include bar codes, data 
matrix codes, MaxiCodes, and so forth. Graphical codes have become widely used in many 
commercial environments, such as point-of-sale stations in retail stores and supermarkets, 
inventory and document tracking, and the like. 

[04] Devices for identifying or extracting information fi"om graphical codes are generally 
referred to as graphical code readers. Graphical code readers typically include one or more light 
sources for illuminating a graphical code. Light is reflected from the graphical code toward the 
graphical code reader. A lens within the graphical code reader focuses an image of the graphical 
code onto an image sensor. Pixels within the image sensor are read electronically to provide a 
two-dimensional array of image data corresponding to the graphical code. A decoder then 
processes the image data and extracts the information contained in the graphical code. 



[05] Two-dimensional graphical codes possess several advantages over one-dimensional 
graphical codes. For example, two-dimensional graphical codes are designed to store 
considerably more information than one-dimensional graphical codes. In addition, two- 
dimensional graphical codes are typically smaller than one-dimensional codes. Also, in some 
cases, two-dimensional graphical codes do not require a high level of print quality in order to be 
decoded. 

[06] Known graphical code readers sequentially perform the functions of image capture and 
decoding. That is, known graphical code readers capture an image. When the image is fully 
captured, the captured image is processed (i.e., an attempt is made to locate and decode graphical 
codes in the image). When the image has been fiilly decoded, another image is captured. This 
process is then typically repeated until a successful decoding operation is performed (i.e., a 
graphical code is located in an image and the graphical code is successfully decoded). However, 
benefits may be realized by a graphical code reader that is configured for concurrent image 
capture and decoding. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[07] The present embodiments will become more fully apparent from the following 

description and appended claims, taken in conjunction with the accompanying drawings. 

Understanding that these drawings depict only typical embodiments and are, therefore, not to be 

considered limiting of the invention's scope, the embodiments will be described with additional 

specificity and detail through use of the accompanying drawings in which: 

[08] Figure 1 is a block diagram illustrating functional components in an embodiment of a 

graphical code reader that is configured for concurrent image capture and decoding; 

[09] Figure 2 is a flow diagram illustrating an embodiment of a method for concurrent image 

capture and decoding; 

[10] Figure 2 A is a timing diagram illustrating exemplary operation of the image capture 
component and the decoding component in the embodiment of Figures 1-2; 
[11] Figure 3 is a block diagram illustrating functional components in another embodiment of 
a graphical code reader that is configured for concurrent image capture and decoding; 
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[12] Figure 4 is flow diagram illustrating another embodiment of a method for concurrent 
image capture and decoding; 

[13] Figure 4A is a timing diagram illustrating exemplary operation of the image capture 

component and the decoding component in the embodiment of Figures 3-4; 

[14] Figure 5 is a block diagram illustrating functional components in another embodiment of 

a graphical code reader that is configured for concurrent image capture and decoding; 

[15] Figure 6 is a flow diagram illustrating another embodiment of a method for concurrent 

image capture and decoding; 

[16] Figure 6A is a timing diagram illustrating exemplary operation of the image capture 

component and the decoding component in the embodiment of Figures 5-6; 

[17] Figure 7 is a block diagram illustrating functional components in another embodiment of 

a graphical code reader that is configured for concurrent image capture and decoding; 

[18] Figure 8 is flow diagram illustrating another embodiment of a method for concurrent 

image capture and decoding; and 

[19] Figure 9 is a block diagram illustrating physical components in an embodiment of a 
graphical code reader. 

DETAILED DESCRIPTION 

[20] A method in a graphical code reader for concurrent image capture and decoding is 
disclosed. The method involves capturing a first image. The first image is processed by 
searching for a graphical code within the first image and attempting to decode the graphical code. 
A second image is captured while the first image is being processed. 

[21] Li some embodiments, the capturing of the second image starts when the processing of 
the first image starts. Alternatively, the method may involve determining an estimated 
processing time p for processing at least some of the first image, and determining an estimated 
capture time c for capturing the second hnage. In such embodiments, the capturing of the second 
image may start p-c time units after the processing of the first image starts. The method may 
also involve stopping the processing of the first image p time units after the processing of the 
first image starts. 



[22] The estimated processing time p may be an estimate of an amount of time required to 
process the entire first image. Altematively, the estimated processing time p may be an estimate 
of an amount of time required to process a portion of the first image. In such embodiments, the 
estimated processing time p may be a function of at least one of the quaUty of the first image, the 
number of symbols in the graphical code, and the complexity of the symbols in the graphical 
code. 

[23] A graphical code reader that is configured for concurrent image capture and decoding is 
also disclosed. The graphical code reader includes a decoding component configured to process 
a first image by searching for a graphical code within the first image and attempting to decode 
the graphical code. The graphical code reader also includes an image capture component 
configured to capture the first image and to capture a second image while the first image is being 
processed by the decoding component. The graphical code reader also includes a pool of image 
buffers for temporarily storing the first image and the second image. 

[24] Various embodiments of the invention are now described with reference to the Figures, 
where like reference numbers indicate identical or fimctionally similar elements. It will be 
readily understood that the components of the present invention, as generally described and 
illustrated in the Figures herein, could be arranged and designed in a wide variety of different 
configurations. Thus, the following more detailed description of several exemplary embodiments 
of the present invention, as represented in the Figures, is not intended to limit the scope of the 
invention, as claimed, but is merely representative of the embodiments of the invention. 
[25] The word "exemplary" is used exclusively herein to mean "serving as an example, 
instance, or illustration." Any embodiment described herein as "exemplary" is not necessarily to 
be construed as preferred or advantageous over other embodiments. While the various aspects of 
the embodiments are presented in drawings, the drawings are not necessarily drawn to scale 
unless specifically indicated. 

[26] Those skilled in the art will appreciate that many features of the embodiments disclosed 
herein may be implemented as computer software, electronic hardware, or combinations of both. 
To clearly illustrate this interchangeability of hardware and software, various components will be 
described generally in terms of their fimctionality. Whether such fiinctionality is implemented as 



hardware or software depends upon the particular application and design constraints imposed on 
the overall system. Skilled artisans may implement the described functionality in varying ways 
for each particular application, but such implementation decisions should not be interpreted as 
causing a departure from the scope of the present invention. 

[27] Where the described fimctionaUty is implemented as computer software, those skilled in 
the art will recognize that such software may include any type of computer instruction or 
computer executable code located within a memory device and/or transmitted as electronic 
signals over a system bus or network. Software that implements the fimctionality associated with 
components described herein may comprise a single instruction, or many instructions, and may 
be distributed over several different code segments, among different programs, and across several 
memory devices. 

[28] Figure 1 is a block diagram illustrating fimctional components in an embodiment of a 
graphical code reader 102 that is configured for concurrent image capture and decoding. The 
illustrated fimctional components may be implemented using any suitable combination of 
hardware, software, and/or firmware. 

[29] The graphical code reader 102 includes an image capture component 106. The image 
capture component 106 emits illumination 108 directed at a particular area. Light 110 is 
reflected from the objects located within the illuminated area. The image capture component 106 
receives the reflected light 110 and captures an electronic image 112 of the objects within its 
field of view. In typical operation, the graphical code reader 102 is positioned so that a graphical 
code 104 is located within the field of view of the image capture component 106. When this 
occurs, the image capture component 106 generates an electronic image 112 of the graphical 
code 104. 

[30] The graphical code reader 102 also includes a pool of image buffers 114. Electronic 
images 112 captured by the image capture component 106 are temporarily stored in the image 
buffers 1 14. In the illustrated embodiment, the optimum number of image buffers 1 14 is three: a 
first image buffer 114 for the current in-progress image capture, a second image buffer 114 for 
the last complete image capture, and a third image buffer for use by the decoding component 
116. Of course, the graphical code reader 102 may include more than three image buffers 114. 



[31] The graphical code reader 102 also includes a decoding component 116. The decoding 
component 116 retrieves an electronic image 112 from one of the image buffers 114 and 
processes it in order to decode any graphical codes 104 contained therein. Processing an 
electronic image 112 typically involves searching for graphical code symbols within the 
electronic image 112. For each graphical code symbol that is identified, the decoding component 
116 determines the data that the graphical code symbol represents. The decoding component 116 
then outputs decoded data 118. 

[32] In the illustrated embodiment, both the image capture component 106 and the decoding 
component 1 16 are configured so that they operate continuously. That is, once the image capture 
component 106 finishes capturing an electronic image 112, the image capture component 106 
starts to capture a new electronic image 112. Similarly, once the decoding component 116 
finishes processing an electronic image 112, the decoding component 116 starts to process a new 
electronic image 1 12 (if one is available). 

[33] Under some circumstances, the image capture component 106 may capture several 
images in the amount of time that it takes the decoding component 1 16 to process a single image. 
This may be the case, for example, when a two-dimensional graphical code 104 is being read, 
because more time is typically required to process an image 112 of a two-dimensional graphical 
code 104 than to capture such an image 112. In such an embodiment, after the decoding 
component 116 has finished processing an image 112, the decoding component 116 may begin 
processing the newest captured image 112. Because the newest image 112 is processed, some 
images 112 captured by the image capture component 106 may never be processed. Once all of 
the image buffers 1 14 are full, then the oldest image 1 12 in the image buffers 114 may be deleted 
in order to make room for a new image 1 12. 

[34] Figure 2 is a flow diagram illustrating an embodiment of a method 200 for concurrent 
image capture and decoding. The method 200 may be performed by the graphical code reader 
102 of Figure 1. The order of the steps of the method 200 is for illustrative purposes only and is 
not meant to imply a required order. 

[35] The method 200 begins when the image capture component 106 captures 202 an 
electronic image 112 of the objects within its field of view. The electronic image 112 may 
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include a graphical code 104. However, under some circumstances the electronic image 112 may 
not include a graphical code 104. For example, a user may activate the graphical code reader 102 
while the user is moving a graphical code 104 into the field of view of the image capture 
component 106. 

[36] The decoding component 116 then processes 204a the newest captured image 112. At 
this point in the method 200, the newest captured image is the image 112 captured in step 202. 
As discussed above, processing 204a an electronic image 112 typically involves searching for 
graphical-code symbols in the image 1 12, and then decoding the graphical code symbols. While 
the decoding component 116 processes 204a the image 112, the image capture component 106 
continuously captures 204b new images 112. As discussed above, the image capture component 
106 may capture 204b several images 112 in the amoimt of time that it takes the decoding 
component 1 16 to process 204a a single image 112. 

[37] After the decoding component 116 finishes processing 204a the newest captured image 
112, the decoding component 116 determines 206 whether decoding has been successful. For 
example, the decoding component 116 may determine whether a graphical code 104 was located 
in the image 112, and if so, whether the graphical code 104 was successfully decoded. If the 
decoding component 116 determines 206 that decoding has been successful, the method 200 
ends. If not, the method 200 returns to steps 204a, 204b and proceeds as described above. 
[38] As mentioned above, when step 204a is executed the first time, the previously captured 
image 1 12 is the image 1 12 captured during step 202. However, during subsequent execution of 
step 204a, the previously captured image 112 is the newest image 112 captured during the 
previous execution of step 204b. 

[39] Figure 2A is a timing diagram illustrating exemplary operation of the image capture 
component 106 and the decoding component 116 in the embodiment of Figures 1-2. In the 
discussion that follows, imagCi refers to the image 112 which the image capture component 106 
starts capturing at time t\. 

[40] The example begins at time to. At time to the image capture component 106 starts 
capturing imageo. This is indicated by block Co at time to. 
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[41] At time ti the image capture component 106 has finished capturing imageo. The decoding 
component 116 starts processing the newest captured image, which is imageo. This is indicated 
by block Do at time ti. In the embodiment of Figures 1-2, the image capture component 106 
continuously captures new images 112 while the decoding component 116 is processing an 
image 112. Consequently, the image capture component 106 starts capturing imagei at time ti. 
This is indicated by block Ci at time ti. 

[42] At time t2 the image capture component 106 has finished capturing imagei, and starts 
capturing image2. This is indicated by block C2 at time t2. The decoding component 116 
continues processing imageo. 

[43] At time ta the image capture component 106 has finished capturing image2, and starts 
capturing imagea. This is indicated by block C3 at time ta. The decoding component 116 
continues processing image©- 

[44] At time U the image capture component 106 has finished capturing images, and starts 
capturing image4. This is indicated by block C4 at time t4. The decoding component 116 
continues processing image©. 

[45] At time ts the image capture component 106 has finished capturing image4. The decoding 
component 116 has finished processing image©, which was not successfixUy decoded. The 
decoding component 116 starts processing the newest captured image 1 12, which is image4. This 
is indicated by block D4 at time ts. The image capture component 106 starts capturing images. 
This is indicated by block C5 at time ts. 

[46] At time U the image capture component 106 has finished capturing images, and starts 
capturing image6. This is indicated by block Ce at time te. The decoding component 116 
continues processing image4. 

[47] At time t-j the image capture component 106 has finished capturing imagea, and starts 
capturing image?. This is indicated by block C7 at time t?. The decoding component 116 
continues processing image4. 

[48] At time tg the image capture component 106 has finished capturing image?, and starts 
capturing imageg. This is indicated by block Cs at time tg. The decoding component 116 
continues processing image4. 



[49] At time tg the image capture component 106 has finished capturing imageg. The decoding 
component 116 has finished processing image4, which was not successfully decoded. The 
decoding component 116 starts processing the newest captured image 112, which is imageg. This 
is indicated by block Dg at time t9. The image capture component 106 starts capturing imagCQ. 
This is indicated by block C9 at time tg. 

[50] At time tio the image capture component 106 has finished capturing imageg, and starts 
capturing imageio. The decoding component 116 continues processing imageg. The image 
capture component 106 and the decoding component 116 may continue in the above-described 
manner until the decoding component 116 successfully decodes an image 112. 
[51] As can be seen from Figure 2A, the graphical code reader 102 of Figures 1-2 has low 
latency, i.e., the decoding component 116 is processing newly captured images 112. However, 
the image capture component 106 is overworked, i.e., it captures a number of images 112 that 
aren't used. This can adversely affect the performance of the decoding component 116 in a 
shared bus system. 

[52] Figure 3 is a block diagram illustrating functional components in another embodiment of 
a graphical code reader 302 that is configured for concurrent image capture and decodmg. As 
with the embodiment described previously, the illustrated functional components may be 
implemented using any suitable combination of hardware, software, and/or firmware. 
[53] The graphical code reader 302 shown in Figure 3 is similar to the graphical code reader 
102 shown in Figure 1, except for the following. In the embodiment shown in Figure 3, the 
image capture component 306 is configured so that it only captures a single new image 312 
during the time that the decoding component 316 processes an image 312. The decoding 
component 316 processes the image 312 that was previously captured by the image capture 
component 306. This functionality may be accomplished by means of a controller 322, as shown 
in Figure 3. In the illustrated embodiment, the image capture component 306 is configured so 
that it captures electronic images 312 in accordance with image capture instructions 324 received 
fi'om the controller 322. The image capture component 306 does not otherwise capture images 
312. 
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[54] When the decoding component 316 finishes processing an image 312 without 
successfully decoding the image 312, the decoding component 316 immediately starts to process 
the next image 312 if the next image 312 is available. (If the next image 312 is not available, the 
decoding component 316 waits until the next image 312 becomes available.) The decoding 
component 316 provides a signal 326 to the controller 322 indicating that the decoding 
component 316 is now starting to process the next image 312. After receiving the signal 326 
from the decoding component 316, the controller 322 sends a signal 324 to the image capture 
component 306 instructing the image capture component 306 to start capturing a new image 312. 
[55] The graphical code reader 302 shown in Figure 3 includes a pool of image buffers 314. 
In the illustrated embodiment, the optimum number of image buffers 314 is two: a first image 
buffer 314 for the current in-progress image capture, and a second image buffer 314 for use by 
the decoding component 316. At any given time, one image buffer 314 is allocated for image 
capture and the other image buffer 314 is allocated for decoding. On the next frame, the buffer 
314 that was the decoding buffer 314 becomes the capture buffer 314, and the buffer 314 that 
was the capture buffer 314 becomes the decode buffer 314. Of course, the graphical code reader 
302 may include more than two image buffers 314. 

[56] Figure 4 is flow diagram illustrating another embodiment of a method 400 for concurrent 
image capture and decoding. The method 400 may be performed by the graphical code reader 
302 of Figure 3. The order of the steps of the method 400 is for illustrative purposes only and is 
not meant to imply a required order. 

[57] The method 400 begins when the image capture component 306 captures 402 an 
electronic image 312 of the objects within its field of view. After the image 312 has been 
captured and is available for processing, the decoding component 316 processes 404a the image 
312 and the image capture component 306 captures 404b a single new image 312. The steps 
404a, 404b are performed substantially in parallel. Typically, it takes longer for the decoding 
component 316 to process an image 312 than it takes for the image capture component 306 to 
capture an image 312. Thus, in typical operation, the image capture component 306 finishes 
capturing a new image 312 before the decoding component 306 finishes processing the 
previously captured image 312. 



-11- 

[58] After the decoding component 316 finishes processing 404a the image 312, the decoding 
component 316 determines 406 whether decoding has been successful. If the decoding 
component 316 determines 306 that decoding has been successful, the method 400 ends. If not, 
the method 400 returns to steps 404a, 404b and proceeds as described above. 
[59] When step 404a is executed the first time, the decoding component 316 processes 404a 
the image 312 captured during step 402. Diuing subsequent execution of step 404a, the decoding 
component 316 processes 404a the image 312 captured during the previous execution of step 
404b. 

[60] Figure 4A is a timing diagram illustrating exemplary operation of the image capture 
component 306 and the decoding component 316 in the embodiment of Figures 3-4. The 
example begins at time to- At time to the image capture component 306 starts capturing imageo. 
This is indicated by block Co at time to. 

[61] At time ti the image capture component 306 has finished capturing imageo. The decoding 
component 316 starts processing imageo. This is indicated by block Do at time ti. In the 
embodiment of Figures 3-4, the image capture component 306 captures a single new image 312 
when the decoding component 316 starts processing an image 312. Consequently, the image 
capture component 306 starts capturing imagei at time ti. This is indicated by block Ci at time 
ti. 

[62] At time t2 the image capture component 306 has finished capturing imagei. However, the 
decoding component 316 has not finished processing imageo, so the image capture component 
306 remains idle and does not start capturing a new image 312. The decoding component 316 
continues processing image©. 

[63] At times ts and t4 the image capture component 306 remains idle. The decoding 
component 316 continues processing imageo. 

[64] At time t5 the decoding component 316 has finished processing imageo, which was not 
successfully decoded. The decoding component 316 starts processing imagei. This is indicated 
by block Di at time ts. The image capture component 306 starts capturing images. This is 
indicated by block Cs at time ts. 
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[65] At time t^ the image capture component 306 has finished capturing images. However, the 
decoding component 316 has not finished processing imagei, so the image capture component 
306 remains idle and does not start capturing a new image 312. The decoding component 316 
continues processing imagei. 

[66] At times ty and U the image capture component 306 remains idle. The decoding 
component 316 continues processing imagei. 

[67] At time tg the decoding component 316 has finished processing imagei, which was not 

successfully decoded. The decoding component 316 starts processing images. This is indicated 
by block D5 at time tg. The image capture component 306 starts capturing imageg. This is 
indicated by block C9 at time tg. 

[68] At time tio the image capture component 306 has finished capturing imageg. However, 
the decoding component 316 has not finished processing images, so the image capture 
component 306 remains idle and does not start capturing a new image 312. The decoding 
component 316 continues processing images. The image capture component 306 and the 
decoding component 316 may continue in the above-described manner until the decoding 
component 316 successfiiUy decodes an image 312. 

[69] As can be seen fi-om Figure 4A, in the graphical code reader 302 of Figures 3-4 the image 
capture component 306 does not capture unnecessary images 312, thereby sparing the bus fi'om 
unneeded captures. However, the reader 302 has higher latency, i.e., the decoding component 
316 is processing aged images 312. 

[70] Figure 5 is a block diagram illustrating fiinctional components in another embodiment of 
a graphical code reader 502 that is configured for concurrent image capture and decoding. As in 
the embodiments described previously, the illustrated fimctional components may be 
implemented using any suitable combination of hardware, software, and/or firmware. 
[71] The graphical code reader 502 shown in Figure 5 is similar to the graphical code reader 
302 shown in Figure 3, except for the following. In the embodiment shown in Figure 5, the 
graphical code reader 502 is configured so that the image capture component 506 finishes 
capturing a single new image 512 at about the same time that the decoding component 516 
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finishes processing the previously captured image 512. In this way, the decoding component 516 
will always be processing the most current image 512 that is available. 

[72] In the illustrated embodiment, this functionality is accomplished by means of an 
estimation component 528. The estimation component 528 generates a processing estimate 530, 
which is an estimate of how long it will take for the decoding component 516 to process an entire 
image 512, The estimation component 528 also generates a captwe estimate 532, which is an 
estimate of how long it will take for the image capture component 506 to capture an image 512. 
The processing estimate 530 is p time units in duration, and the capture estimate 532 is c time 
units in duration. The estimation component 528 provides the processing estimate 530 and the 
capture estimate 532 to the controller 522. 

[73] As before, when the decoding component 516 finishes processing an image 512 without 
successfully decoding the image 512, the decoding component 516 immediately starts to process 
the next image 512 if the next image 512 is available. (If the next image 512 is not available, the 
decoding component 516 waits until the next image 512 becomes available.) The decoding 
component 516 provides a signal 526 to the controller 522 indicating that the decoding 
component 516 is now starting to process the next image 512. 

[74] The controller 522 sends image capture instructions 524 to the image capture component 
506. The image capture instructions 524 instruct the image capture component 506 to start 
capturing a single new image 5X2 p - c time units after the decoding component 516 starts to 
process the previously captured image 512. 

[75] The graphical code reader 502 shown in Figure 5 includes a pool of image buffers 514. 
In the illustrated embodiment, the optimum number of image buffers 514 is two: a first image 
buffer 514 for the current in-progress image capture, and a second image buffer 514 for use by 
the decoding component 516. Of course, the graphical code reader 502 may include more than 
two image buffers 514. 

[76] Figure 6 is a flow diagram illustrating another embodiment of a method 600 for 
concurrent image capture and decoding. The method 600 may be performed by the graphical 
code reader 502 of Figure 5. The order of the steps of the method 600 is for illustrative purposes 
only and is not meant to imply a required order. 



-14- 



[77] The method 600 begins when the estimation component 528 provides 602 a processing 
estimate 530 and a capture estimate 532. The processing estimate 530 is p time units in duration, 

and the capture estimate 532 is c time units in duration. 

[78] The processing estimate 530 might be based on statistical samplings of observed decode 
times for "typical" codes 502 and images 512. For example, the estimate may be the average 
decode time or some higher threshold, such as the time where a certain percentage (e.g., 75%) of 
samples were completed. The processing estimate 530 might be a linear function of quality 
and/or image size (or window-of-interest within the image 512). The processing estimate 530 
might be based on details about how the image 512 is processed in the decoding component 516, 
which would be known to those skilled in the art of decoding graphical codes 502 from captured 
images 512. The processing estimate 530 might also be based on a combination of the above, 
and/or on additional factors not mentioned above. The capture estimate 532 may be calculated 
according to the following formula: (image size / average transfer rate) + start-capture latency. 
[79] The image capture component 506 captures 604 an electronic image 512 of the objects 
within its field of view. After the image 512 has been captured and is available for processing, 
the decoding component 516 starts processing 606 the image 512. The image capture component 
506 starts capturing 608 a single new image Slip- c time xmits after the decoding component 
516 starts processing the previously captured image 512. 

[80] If the processing estimate p is accurate, the decoding component 616 finishes processing 
the previously captured image 512 at substantially the same time that the image capture 
component 506 finishes capturing the single new image 512. Of course, under some 
circumstances the processing estimate p may not be accurate, and the decoding component 516 
may finish processing the image 512 either before or after the image capture component 506 
finishes capturing the new image 512. 

[81] After the decoding component 516 finishes processing the previously captured image 
512, the decoding component 516 determines 610 whether decoding has been successful. If 
decoding has been successfiil, the method 600 ends. If decoding has not been successfiil, the 
method 600 retums to step 606 and proceeds as described above. 



-15- 

[82] When step 606 is executed the first time, the decoding component 516 processes 606 the 
image 512 captured during step 604, During subsequent execution of step 606, the decoding 
component 516 processes 606 the image 512 captured during the previous execution of step 608. 
[83] Figure 6A is a timing diagram illustrating exemplary operation of the image capture 
component 506 and the decoding component 516 in the embodiment of Figures 5-6. The 
example begins at time to. At time to the image capture component 506 starts capturing imageo. 
This is indicated by block Co at time to. 

[84] At time ti the image capture component 506 has finished capturing image©. The decoding 
component 516 starts processing image©. This is indicated by block Do at time ti. In the 
embodiment of Figures 5-6, the image capture component 506 starts capturing a single new 
image 512/? - c time units after the decoding component 516 starts processing the current image 
512. Consequently, the image capture component 506 remains idle at time ti and does not start 
capturing a new image 512. 

[85] At times t2 and ts the image capture component 506 remains idle. The decoding 
component 516 continues processing image©. 

[86] At time U p - c time units have elapsed since the decoding component 516 started 
processing image©. Consequently, the image capture component 506 starts capturing image4. 
This is indicated by block C4 at time U- The decoding component 516 continues processing 
image©. 

[87] At time 1$ the decoding component 516 has finished processing image©, which was not 
successfully decoded. The image capture component 506 has finished capturing image4. The 
decoding component 516 starts processing image4. This is indicated by block D4 at time ts. The 
image capture component 506 remains idle at time ts and does not start capturing a new image 
512. 

[88] At times te and ty the image capture component 506 remains idle. The decoding 
component 516 continues processing image4. 

[89] At time U p - c time xmits have elapsed since the decoding component 516 started 
processing image4. Consequently, the image capture component 506 starts capturing images. 
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This is indicated by block C% at time tg. The decoding component 516 continues processing 
image4. 

[90] At time t9 the decoding component 516 has finished processing image4, which was not 
successfully decoded. The image capture component 506 has finished capturing imageg. The 
decoding component 516 starts processing imageg. This is indicated by block Dg at time tg. The 
image capture component 506 remains idle at time t9 and does not start capturing a new image 
512. 

[91] At time tio the image capture component 506 remains idle. The decoding component 516 
continues processing imageg. The image capture component 506 and the decoding component 
516 may continue in the above-described manner until the decoding component 516 successfully 
decodes an image 512. 

[92] As can be seen firom Figure 6A, in the graphical code reader 502 of Figures 5-6 the image 
capture component 506 does not capture unnecessary images 512, thereby sparing the bus from 
unneeded captures. In addition, the reader 502 has low latency, i.e., the decoding component 516 
is processing newly captured images 512. 

[93] Figure 7 is a block diagram illustrating functional components in another embodiment of 
a graphical code reader 702 that is configiwed for concurrent image capture and decoding. As in 
the embodiments described previously, the illustrated functional components may be 
implemented using any suitable combination of hardware, software, and/or firmware. 
[94] The graphical code reader 702 shown in Figure 7 is similar to the graphical code reader 
502 shown in Figure 5, except for the following. In the embodiment shown in Figure 7, the 
decoding component 716 is configured to first process the portions of an image 712 that have the 
highest probabiUty of including a graphical code 704. This is sometimes referred to as 
processing the "best candidates" before the "worst candidates." For example, a simplistic best 
candidate choice would be to start analysis of an image 712 at the center and work outward, 
because the operator of the graphical code reader 702 typically attempts to place the code 704 in 
the center of the field of view of the image capture component 706. Another approach would be 
to examine the image 712 at low resolution to locate and rank candidate areas and then examine 
each candidate area at high resolution. Whatever approach is followed, the decoding component 
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716 may be thought of as having high probability decoding time followed by lower probability 
decoding time. In the embodiment shown in Figure 7, the graphical code reader 702 is 
configured so that the decoding component 716 stops processing images 712 after the high 
probabiUty time has elapsed and before the lower probability time begins. 
[95] This fimctionality may be implemented by means of the estimation component 728. 
More specifically, the processing estimate (p) 730 generated by the estimation component 728 
may be an estimate of how long it will take for the decoding component 716 to process the 
portion of an image 712 that is most likely to include a graphical code 704. The controller 722 
sends a signal 734 to the decoding component 716 which instructs the decoding component 716 
to stop processing a particular image 712 p time units after the decoding component 716 starts to 
process the image 712. By limiting the amount of time the decoding component 716 processes 
images 712, the use of high probability time is maximized and the use of less-efficient low 
probability time is minimized. 

[96] The graphical code reader 702 shown in Figure 7 includes a pool of image buffers 714. 
In the illustrated embodiment, the optimum number of image buffers 714 is two: a first image 
buffer 714 for the current in-progress image capture, and a second image buffer 714 for use by 
the decoding component 716. Of course, the graphical code reader 702 may include more than 
two image buffers 714. 

[97] Figure 8 is flow diagram illustrating another embodiment of a method 800 for concurrent 
image capture and decoding. The method 800 may be performed by the graphical code reader 
702 of Figure 7. The order of the steps of the method 800 is for illustrative purposes only and is 
not meant to imply a required order. 

[98] The method 800 shown in Figure 8 is similar in many respects to the method 600 shown 
in Figure 6. The method 800 begins when the estimation component 728 provides 802 a 
processing estimate 530 and a capture estimate 532. The processing estimate 730 is p time units 
in duration, and the capture estimate 732 is c time units in duration. The image capture 
component 706 captures 804 an electronic image 712 of the objects within its field of view. 
After the image 712 has been captured and is available for processing, the decoding component 
716 starts processing 806 the image 712. The image capture component 706 starts capturing 808 
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a single new image 712 p-c time units after the decoding component 716 starts processing the 
previously captured image 712. 

[99] In the illustrated embodiment, the decoding component 716 stops processing 810 the 
current image p time units after processing started, whether or not the decoding component 716 
is finished processing the entire image 712, Thus, if the capture estimate c is accurate, the image 
capture component 706 finishes capturing a new image 712 when the decoding component 716 
stops processing the previously captured image 712. Of course, under some circumstances the 
capture estimate c may not be correct, and the image capture component 706 may finish 
capturing a new image 712 either before or after the decoding component 716 stops processing 
the previously captured image 712. 

[100] The decoding component 716 then determines 812 whether decoding has been successfiil. 
If decoding has been successfiil, the method 800 ends. If decoding has not been successfiil, the 
method 800 returns to step 806 and proceeds as described above. 

[101] When step 806 is executed the first time, the decoding component 716 processes 806 the 
image 712 captured during step 804. During subsequent execution of step 806, the decoding 
component 716 processes 806 the image 712 captured during the previous execution of step 808. 
[102] In the embodiment described in connection with Figures 7-8, the processing estimate 730 
may be a fimction of the quality of the image 712, the number of symbols in the graphical code 
704, the complexity of the symbols, details about how the image 712 is processed in the 
decoding component 716, and so forth. The quality of the image 712 generally includes the 
contrast of the image 712 and may also include other factors that vary by symbology and details 
about how the image 712 is processed in the decoding component 716. A user-configurable 
factor and offset may also be provided for tailoring this estimate 730 for specific conditions. 
[103] An example of how the processing estimate 730 may be calculated is: 
processing estimate = cO + cl * quality + c2 * numberOfSymbologiesEnabled + c3 * 
complexityOfSymbols + c4 * numberOfConcurrentSymbols 

where cO-c4 are tunable parameters (user selectable). The complexityOfSymbols variable refers 
to the number of features in the symbols to be decoded (e.g., a datamatrix code can be as small as 
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10x10 features or up to as large as 100x100 or more). The numberOfConcurrentSymbols 
variable refers to how many distinct symbols should be decoded within a single image 712. 
[104] Figure 9 is a block diagram illustrating physical components in an embodiment of a 
graphical code reader 902. The physical components shown in Figure 9 may be used to 
implement the functional components described previously. The different components may be 
located within the same physical structure or in separate physical structures. 
[105] The graphical code reader 902 includes an illumination component 978. The illumination 
component 978 typically includes a plurality of illumination elements that may be activated to 
illuminate a graphical code 904. The illumination component 978 is controlled by an 
illumination controller 980, which is in electronic communication with other components in the 
graphical code reader 902 via a system bus 982. 

[106] The graphical code reader 902 also includes imaging optics 984 and an image sensor 986. 
The image sensor 986 includes a plurality of light-sensitive elements. The imaging optics 984 
focus light reflected from the area illuminated by the illumination component 978 onto the image 
sensor 986. Examples of image sensors 986 include charge coupled devices (CCDs) and 
complementary metal-oxide semiconductor (CMOS) sensors. A housing (not shown) is typically 
also provided for shielding the light-sensitive elements in the image sensor 986 from ambient 
light. The image sensor 986 is in electronic communication with other components in the 
graphical code reader 902 via the system bus 982. 

[107] The graphical code reader 902 also includes a processor 988 and memory 990. The 
processor 988 controls the operation of the graphical code reader 902 and may be embodied as a 
microprocessor, a microcontroller, a digital signal processor (DSP) or other device known in the 
art. The processor 988 typically performs logical and arithmetic operations based on program 
instructions stored within the memory 990. 

[108] As used herein, the term ''memory" 990 is broadly defined as any electronic component 
capable of storing electronic information, and may be embodied as read only memory (ROM), 
random access memory (RAM), magnetic disk storage media, optical storage media, flash 
memory devices in RAM, on-board memory included with the processor 988, EPROM memory, 
EEPROM memory, registers, etc. The memory 990 typically stores program instructions and 
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other types of data. The program instructions may be executed by the processor 988 to 
implement some or all of the methods disclosed herein. The processor 988 and memory 990 are 
in electronic communication with other components in the graphical code reader 902 via the 
system bus 982. 

[109] The graphical code reader 902 typically also includes one or more progranraiable logic 
devices (PLDs) 992. The PLDs 992 may be programmed to carry out logic functions that 
implement, either partially or completely, some or all of the methods disclosed herein. Examples 
of different types of PLDs 992 that may be used include field-programmable gate arrays 
(FPGAs), logic-cell arrays (LCAs), programmed arrays of logic (PALs), complex programmable- 
logic devices (CPLDs), and so forth. The PLDs 992 are in electronic communication with other 
components in the graphical code reader 902 via the system bus 982. Those skilled in the art will 
recognize that one or more application-specific integrated circuits (ASICs) may be used in place 
of or in addition to the PLDs 992. 

1110] The graphical code reader 902 typically also includes one or more communication 
interfaces 994 for communicating with other electronic devices. The communication interfaces 
994 may be based on wired communication technology, wireless communication technology, or 
both. Examples of different types of communication interfaces 994 include a serial port, a 
parallel port, a Universal Serial Bus (USB), an Ethernet adapter, an IEEE 1394 bus interface, a 
small computer system interface (SCSI) bus interface, an infrared (IR) communication port, a 
Bluetooth wireless communication adapter, and so forth. The communication interfaces 994 are 
in electronic communication with other components in the graphical code reader 902 via the 
system bus 982. 

[Ill] The graphical code reader 902 typically also includes one or more input device controllers 
996 for controlling input devices, such as keys, buttons, etc. The graphical code reader 902 
typically also includes one or more output device controllers 998 for controlling output devices, 
such as a display screen. The input device controllers 996 and output device controllers 998 are 
in electronic communication with other components in the graphical code reader 902 via the 
system bus 982. 
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[112] While specific embodiments and applications of the present invention have been 
illustrated and described, it is to be understood that the invention is not Hmited to the precise 
configuration and components disclosed herein. Various modifications, changes, and variations 
which will be apparent to those skilled in the art may be made in the arrangement, operation, and 
details of the methods and systems of the present invention disclosed herein without departing 
from the spirit and scope of the invention. 
[113] What is claimed is: 



